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Abstract: The Palmer drought severity index (PDSI), standardized precipitation index (SPI), and 
standardized precipitation evapotranspiration index (SPEI) are used worldwide for drought assessment 
and monitoring. However, substantial differences exist in the performance for agricultural drought among 
these indices and among regions. Here, we performed statistical assessments to compare the strengths of 
different drought indices for agricultural drought in the North China Plain. Small differences were 
detected in the comparative performances of SPI and SPEI that were smaller at the long-term scale than 
those at the short-term scale. The correlation between SPI/SPEI and PDSI considerably increased from 
1- to 12-month lags, and a slight decreasing trend was exhibited during 12- and 24-month lags, indicating a 
12-month scale in the PDSI, whereas the SPI was strongly correlated with the SPEI at 1- to 24-month lags. 
Interestingly, the correlation between the trend of temperature and the mean absolute error and its 
correlation coefficient both suggested stronger relationships between SPI and the SPEI in areas of rapid 
climate warming. In addition, the yield—drought correlations tended to be higher for the SPI and SPEI 
than that for the PDSI at the station scale, whereas small differences were detected between the SPI and 
SPEI in the performance on agricultural systems. However, large differences in the influence of drought 
conditions on the yields of winter wheat and summer maize were evident among various indices during 
the crop-growing season. Our findings suggested that multi-indices in drought monitoring are needed in 
order to acquire robust conclusions. 
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1 Introduction 


Drought, one of the most severe and frequently occurring natural hazards with diverse 
geographical and temporal distributions, imposes substantial damages and challenges to 
ecosystems and human society (Hao and Singh, 2015; Jiang et al., 2015). Drought may affect a 
wide variety of sectors such as economic, agricultural, ecological, and environmental processes 
worldwide (Du et al., 2013). The large spatial coverage and long-duration characteristics make 
drought one of the most widespread and costliest natural disasters (Potopova et al., 2015). 
Generally, drought is initially caused by deficiencies in precipitation for a particular period in 
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association with global climatic circulation patterns (Nichol and Abbas, 2015). Meanwhile, 
regional drought can cause global impacts such as fluctuation in global food prices induced by 
drought (Wegren, 2011). These issues highlight the importance of agricultural drought monitoring 
(AghaKouchak et al., 2015). Therefore, timely and accurate monitoring of drought severity is an 
important means for water management and drought mitigation efforts (Mishra and Singh, 2010; 
Mu et al., 2013). As reported by Wilhite and Glantz (1985), droughts are classified into four 
categories, i.e., meteorological, agricultural, hydrological, and social economic droughts. 
Meteorological drought is a precipitation deficit caused by atmospheric evaporation; agricultural 
drought is related to soil moisture deficits; hydrological drought is related to deficits in surface 
and subsurface water; and social-economical drought refers to the influence of meteorological 
drought on the socio-economical system (Hao et al., 2015). 

Drought is considered to be the most complex of all natural hazards (Dai, 2011). 
Temporal—spatial identification is difficult owing to the challenges in identifying the moments of 
beginning and ending of a drought and in quantifying its magnitude, duration, and spatial extent 
(Vicente-Serrano et al., 2012). Thus, numerous indices have been developed as universally 
accepted tools used to quantify drought impact (Heim, 2002). Several indices are widely used for 
regional- to global-scale drought assessment and monitoring. For example, the Palmer drought 
severity index (PDSJ) that derived from precipitation and temperature has been widely used for 
drought monitoring and assessment (Palmer, 1965; Alley, 1984). This index is based on the 
demand and supply of the water balance model to measure both wetness (positive values) and 
dryness (negative values) (Wells et al., 2004). However, a major limitation of PDSI is its fixed 
time scales and incomparable parameters across different areas (Alley, 1984). The standardized 
precipitation index (SPI) (McKee et al., 1993) is recommended by the World Meteorological 
Organization as a standard drought monitoring index for meteorological drought monitoring and 
analysis. The principle of the SPI is based on conversion of the precipitation data to probabilities 
by using gamma distribution, the results of which are then used to determine the intensity, 
duration, and frequency of drought at given time scale. The common advantage of the SPI is its 
multi-temporal character. Such a feature is essential for assessing drought impacts owing to its 
flexibility and ease in operation in practical drought monitoring. However, the main criticism of 
the SPI is that its calculation is based on only precipitation data. The recently developed 
standardized precipitation evapotranspiration index (SPEI) (Vicente-Serrano et al., 2010) has 
been claimed to outperform the two previous indices (Vicente-Serrano et al., 2012). Both the 
sensitivity of the PDSI to changes in evaporation demand caused by temperature and simplicity of 
calculation and the multi-temporal nature of the SPI are considered in the SPEI framework. 

It should be noted that the aforementioned drought indices have likely led to differences in 
values and change patterns caused mainly by dataset availability and resolution, particularly at 
relatively small scales (Dai, 2013). As a result, high uncertainty may exist in selecting a single 
drought index for a specific purpose (Vicente-Serrano et al., 2012). Therefore, it is essential to 
choose solid and objective criteria for selecting a drought index to be used for a specific task. 
Recently, great efforts have been made to meet the need for more accurate evaluations for better 
decision making in drought mitigation and the use of various objective indices. However, very 
few studies have performed robust statistical assessments by comparing the strengths of various 
drought indices for agricultural drought. Vicente-Serrano et al. (2012) provided a global 
assessment of the performance of different drought indices for monitoring drought impacts on 
several hydrological, agricultural, and ecological response variables. Zhai et al. (2010) 
investigated the spatial variation and trends in PDSI and SPI and their relationship to stream flow 
in 10 large regions of China. Potop (2011) compared different indices to assess drought impacts 
on corn yield in Moldova. Mavromatis (2010) evaluated several drought indices for their abilities 
to monitor soil moisture. Yang et al. (2017) determined the regional applicability of seven 
meteorological drought indices in China. Additionally, other studies have compared drought 
indices to assess the responses of vegetation activity, tree-ring characteristics, and fire frequency 
(Kempes et al., 2008; Quiring and Ganesh, 2010; Drobyshev et al., 2012). 

To our knowledge, few studies have compared the performances of PDSI, SPI, and SPEI on 
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agricultural drought in the North China Plain (NCP). It should be noted that the NCP is major 
grain production area and thus plays a key role in food security. Such a comparison is necessary 
to obtain solid and objective criteria for selecting drought indices to be used for a specific purpose. 
Therefore, the primary purpose of this study is to analyze the performance of the aforementioned 
widely used drought indices for agricultural drought in the NCP. To achieve this objective, several 
steps are performed. First, we analyze the consistency among the three indices, and we calculate 
their correlation coefficients. Next, we discuss the influence of ongoing warming on the 
relationship between the SPI and SPEI. Finally, we calculate the correlation coefficient of each 
drought index and the crop yield of both winter wheat and summer maize. 


2 Materials and methods 


2.1 Study area 


The NCP, formed mainly by the Yellow, Huaihe, Haihe, and Luanhe rivers, is the second largest 
plain in China (Fig. 1). Owing to its flat terrain and fertile soil, the NCP is the main production 
area of food crops, with winter wheat and summer maize rotation as the main cropping pattern 
(Hu et al., 2010). The cultivated land area in the NCP accounts for 27.9% of the total arable land 
in China. The climate of the NCP is warm temperate semi-humid continental monsoon, and the 
precipitation is between 400 and 600 mm, occurring mainly in summer. Significant inter-annual 
and intra-annual variations of precipitation also exist, resulting in frequent drought and flooding 
in this region. With an occurrence of 9 times in 10 years (Hu, 2013), drought severely affects the 
agricultural production and is the most prominent natural hazard in this region. 
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Fig. 1 Study area and meteorological station distribution 


2.2 Datasets 


Meteorological data of 60 meteorological stations in the NCP during 1980-2013, consisting of 
daily mean temperature, daily maximum temperature, daily minimum temperature, relative 
humidity, sunshine hours, wind speed, and precipitation, were collected from the China 
Meteorological Data Sharing Service System (http://data.cma.gov.cn/). In addition, soil data, such 
as soil water content, were derived from the Institute of Soil Science, Chinese Academy of 
Sciences. We used precipitation data to obtain SPI, and other climate data variables to calculate 
PET based on the PM model. Then, we calculated SPEI on the basis of precipitation and PET 
(Vicente-Serrano et al., 2010). We obtained PDSI on the basis of all climate and soil datasets 
(Palmer, 1965). 

To determine the performances of the various drought indices for agricultural drought, we used 
crop yield data to reflect the strengths of the indices in monitoring agricultural drought. Crop 
yield data of winter wheat and summer maize from 12 agricultural meteorological stations were 
collected from the China meteorological data network (http://data.cma.gov.cn) covering the 
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period 2000-2013. Only stations that recorded both meteorological and yield datasets with a 
minimum time series of 10 years were selected in this study. Based on these criteria, we extracted 
12 stations over the NCP for assessing the performance of drought indices on winter wheat yield 
variability, and we only selected 5 stations for summer maize. It should be noted that the scarcity 
datasets highlight the challenges involved in developing this type of research. 


2.3 Methods 


Pearson's correlation analysis was employed to examine the correlation among drought indices as 
well as their relationships with crop yield. The correlation coefficients from 1- to 24-month lags 
of the SPI and SPEI were calculated to reflect the different responses of crop yield to drought 
events. In the analysis, the crop yield data were detrended by using the Z-score method to 
eliminate the influence of non-climatic factors, such as improved technologies for crop 
production and field management (Mavromatis, 2007). Moreover, to compare the results of the 
different crops, we further standardized the time series records of the winter wheat and summer 
maize yields. The drought indices time series of SPI, SPEI, and PDSI were also detrended in the 
correlation analysis in order to focus analysis on correlation in inter-annual variability. 

To investigate the influence of climate warming on the differences between the SPI and SPEI, 
we first calculated the trend of temperature (TEM) for all meteorological stations during 
1981-2014. Then, the mean absolute error (MAE) between the SPI and SPEI was also calculated. 
Finally, we performed correlations between the TEM and MAE, and between the TEM and 
correlation coefficients (CC) of the SPI and SPEI. Additionally, in order to investigate the 
performance of different drought indices for agriculture drought, the variation in crop yield as an 
indicator of drought influence, and we correlated the detrended crop yield and the PDSI, as well 
as 1- to 24-month SPI and SPEI. It should be noted that we separated the crops of winter wheat 
and summer maize in the processing analysis to compare the possible differences of drought 
indices on different crops. 


3 Results and discussion 


3.1 Comparisons of SPI, SPEI, and PDSI 


To compare the performances of various drought indices on drought events, we analyzed the 
monthly time series of the SPI, SPEI with 1-, 3-, 6-, and 12-month lags, and PDSI for all stations 
during 1981-2014 (Fig. 2). The root mean square error (RMSE) of the differences between SPI 
and SPEI decreased as time scale increased, indicating that SPI and SPEI at long-term scale 
reflect long-term water deficit conditions in a certain region that is free of the influence of 
short-term climate variability. Conversely, the short-term drought indices revealed a near-term 
water deficit condition and were more apt to be affected by weather such as temperature increases 
or precipitation deficits. In addition, the differences among the PDSI, SPI, and SPEI were 
compared only for the 12-month lag because the PDSI has a fixed scale of 9-12 months (Jiang et 
al., 2015). Although all drought indices were able to detect the main drought events in the NCP 
during the recent 30 years, certain differences were identified in drought intensity derived by the 
PDSI and SPI as well as those by the PDSI and SPEI (Fig. 2). For example, the drought events in 
2002 and 2014 were more clearly detected by the PDSI than the other two drought indices. It 
should be noted that although the SPI and SPEI have smaller differences and more flexible time 
scales than the PDSI, the principle of SPEI is more clear and robust because it combines both 
principles of SPI and PDSI. 


3.2 Correlation analysis between paired drought indices 


Figure 3 shows the Pearson's correlations between the detrended PDSI and 1- to 24-month 
detrended SPI and SPEI during 1981—2014 for all stations. The correlation between SPI and PDSI 
increased considerably from lags of 1 month to 12 months, and a slight decreasing trend was 
exhibited during 12- and 24-month lags (Fig. 3a). These results suggest that the PDSI can 
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Fig. 2 Drought evolution of the standardized precipitation index (SPI), standardized precipitation 
evapotranspiration index (SPEI), and Palmer drought severity index (PDSI) in the North China Plain (NCP) 
during 1981-2014 (a) and the root mean square error (RMSE) of the difference between SPI and SPEI at the 1- to 
12-month scale (b). The red color indicates drought episode, whereas blue color indicates wet episode. 


effectively reflect the conditions of a 12-month water deficit. The same pattern was also detected 
in the correlation between the SPEI and PDSI (Fig. 3b). The SPI was strongly correlated with the 
SPEI at lags of 1 to 24 months, with a mean correlation coefficient above 0.90 for all available 
stations in the NCP. It should be noted that the error bar in Figure 3c, expressed in terms of 
standard deviation, gradually decreased from 1- to 12-month lags, which further demonstrates the 
result shown in Figure 2b. 


3.3 Responses of SPI and SPEI to climate warming 


A negative correlation was detected between the TEM and MAE, indicating a stronger correlation 
between them in areas of rapid climate warming; and the determination coefficient (R?) was 0.203 
(Fig. 4a). This phenomenon was also identified in the correlation between the TEM and CC, with 
an R? of 0.182 (Fig. 4b). To compare the detailed differences in different areas, we conducted the 
same experiment in Hebei, Henan, and Shandong provinces (Fig. 1). The R? values of the TEM 
and MAE were 0.298 and 0.274 in Hebei and Henan provinces, respectively, whereas those of the 
TEM and CC for these two provinces were 0.228 and 0.315, respectively. It should be noted that 
this phenomenon was not obvious in Shandong Province (data not shown). Our findings are in 
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Fig. 3 Correlation among three drought indices at 1-month lag to 24-month lag. Bars indicate standard 
deviation. 


contrast to previous conclusions in which the SPI exhibited increasing differences with the SPEI 
when the temporal trends of temperature were conspicuous (Vicente-Serrano et al., 2010; Jiang et 
al., 2015). This result occurred likely because the precipitation deficit is the dominant factor to 
cause drought in the NCP, and the temperature has a limited contribution to drought evolution. 
Moreover, the contribution of temperature in areas of rapid climate warming is smaller than that 
in inconspicuous warming regions. However, a better-designed experiment would allow the 
acquisition of more robust conclusions. 
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Fig. 4 Relationship between trend of temperature and mean absolute error (a) and correlation coefficient (b) of 
SPEI and SPI 


3.4 Correlation analysis among drought indices and crop yield 


At the regional scale, large differences were detected between the results from PDSI and those 
from multi-scale SPI and SPEI. In terms of winter wheat, small differences were identified from 
January to May at 9- to 12-month lags, as well as from October to December at 4- to 6-month lags. 
In addition, the correlation coefficients from SPEI and SPI were lower than that from PDSI from 
October to December at the middle and long-term scales. For summer maize, the correlation 
between the detrended summer maize yield and detrended PDSI was highly consistent with the 
results from SPI and SPEI in July at the 2-month lag and in August at the 3-month lag, 
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respectively. Moreover, the correlation coefficients of SPI and SPEI derived from the 1-month lag 
in June, 4-month lag in September, and 5-month lag in October were all higher than that for PDSI 
(Fig. 5). 
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Fig. 5 Correlation coefficients between detrended drought indices and detrended crop yields during winter 
wheat growing season (a) and summer maize growing season (b) in the North China Plain (NCP) 


Station scale analysis of the correlation between the detrended crop yield and detrended 
drought indices was also performed for the 12 agricultural meteorological stations with minimum 
data records of 10 years. It is worth noting that the boxplots of the SPI and SPEI were retrieved 
by the maximum correlation coefficient from 1- to 24-month lags. In contrast to the results from 
the regional scale, we found that the yield—drought correlations tended to be higher for the SPI 
and SPEI than for the PDSI at the station scale, whereas small differences between the SPI and 
SPEI in their performance on agricultural drought were detected. In addition, large differences in 
the influence of drought conditions on winter wheat and summer maize yields were evident 
among different months. During the winter wheat growing season, the correlation coefficients 
(CCs) obtained from the SPI and SPEI were mainly around 0.6 from October to April and around 
0.5 in May before sharply decreasing to around 0.3 in June. This result occurred because winter 
wheat almost completed its growth cycle in June and did not have a great demand for moisture. 
The same pattern was detected by the CCs obtained from the PDSI and winter wheat yield such 
that the CCs from January to May were higher than those in other months, with the highest in 
April. This result is consistent with the key growth stages for winter wheat according to the 
phenological calendar (Fig. 6). In terms of summer maize growing season, the CCs between 
summer maize yield and the SPI and SPEI decreased continuously from June to October, whereas 
the greatest CCs between summer maize yield and the PDSI were observed in July (Fig. 7). 

It should be noted that although significant influences of the demand of atmospheric 
evaporation have been widely reported (Vicente-Serrano et al., 2012), the results of the current 
study highlighted the differences in analyzed system and spatial location. Additionally, the 
magnitudes of the correlations among crop yield and drought indices clearly showed that the SPI 
and SPEI are most capable of monitoring the agricultural drought conditions in the NCP. However, 
our findings do not imply that the PDSI is not useful for some purposes; this index is still used 
worldwide to assess drought conditions in agricultural and hydrological applications. 


4 Conclusions 


In this study, we performed statistical assessments to compare the strengths of different drought 
indices including SPEI, SPI, and PDSI for agricultural drought in the North China Plain. Our 
results indicated that small differences were detected in the comparative performances of the SPI 
and SPEI that were smaller at the long-term scale than those at the short-term scale. The 
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Fig. 6 Correlation coefficients between detrended drought indices and detrended winter wheat yield during 
winter wheat growing season (October of the former year to June of the current year). The upper and lower 
boundaries of the box denote the upper and lower quartiles, respectively. The line in the box denotes the median, 
the lines outside the box denote the upper and lower limits, and + denotes the outlier of the dataset. 


Correlation coefficient 


1.0 1.0 1.0 
Jul 
ae (a) Jun ne (b) 08 (c) Aug 
0.6 0.6 0.6 
+ a E an 
02 02 02 
0.0 0.0 0.0 
0.2 02 0.2 + 
04 04 04 
SPEI SPI PDSI SPEI SPI PDSI SPEI SPI PDSI 
1.0 1.0 
(d) Sep (e) Oct 
B 
: 054 054 
g 0.04 0.04 
5 -0.54 -0.54 
SPEI SPI PDSI SPEI SPI PDSI 


Fig. 7 Correlation coefficients between detrended drought indices and detrended summer maize yield during 
summer maize growing season (June to October of the current year). The upper and lower boundaries of the box 
denote the upper and lower quartiles, respectively. The line in the box denotes the median, the lines outside the 
box denote the upper and lower limits, and + denotes the outlier of the dataset. 


correlation between the SPI and PDSI increased considerably from 1- to 12-month lags, and a 
slight decreasing trend was exhibited during 12- and 24-month lags, indicating a 12-month scale 
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in the PDSI, whereas the SPI was strongly correlated with the SPEI at 1- to 24-month lags. Our 
results also suggested stronger relationships between the SPI and SPEI in areas of rapid climate 
warming. More importantly, the yield—drought correlations tended to be higher for the SPI and 
SPEI than that for the PDSI at the station scale, whereas small differences were detected between 
the SPI and SPEI in the performance on agricultural systems. However, large differences in the 
influence of drought conditions on the yields of winter wheat and summer maize were evident 
among the various indices during the crop-growing season. Our findings suggested that multi- 
indices in drought monitoring are needed in order to acquire robust conclusions. 
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